v32.4.0

Compare Source

This is a feature release with::

• python 3.13 support
• support added for adding required phrases to rules automatically
• misc license and package detection improvements
• new and updated license detection rules and new licenses
• misc bugfixes, dependency and documentation updates

There are new data attributes, and we have a output format version bump
from 4.0.0 to 4.1.0. The changes in Output Data Structure are:

• A new resource level attribute sha1_git is added, which has
  the corresponding checksum value for files, and is empty for
  directories. This is returned optionally with the --info plugin.

• A new resource level attribute is_community is added, which is
  True from commonly used files used for community/project maintainence.
  This is returned optionally with the --classify plugin.

These are the details for the most important changes introduced::

• Add support for adding required phrases in rules automatically using
  some console scripts and CLI options using already marked required
  phrases for the same license-expression and license field attributes
  The new console scripts are:

  • add-required-phrases to add required phrases from other rules or
    license attributes
  • gen-new-required-phrases-rules to add required phrase rules for
    marked required phrase in rules
    This improves detection accuracy and reduces false poshttps://github.com/aboutcode-org/scancode-toolkit/pull/3924ihttps://github.com/aboutcode-org/scancode-toolkit/pull/4237ohttps://github.com/aboutcode-org/scancode-toolkit/pull/4241de-toolkit/pull/4241

• Default value of processes used for scancode scans is changed from
  1 to N-1, where N is the number of CPU processes available in the
  systemhttps://github.com/aboutcode-org/scancode-toolkit/pull/410404

• Also return sha1_git checksums for each files with --info plugin.
  https://github.com/aboutcode-org/scancode-toolkit/issues/62424

• Equivalent words like license and licence, as well as plurals are
  now treated as the same in license detection. With this,
  many redundant rules have been deprecathttps://github.com/aboutcode-org/scancode-toolkit/pull/4215l/4215

• Support running scancode with python3.13
  Update and use latest native dependencies with py3.13 support,
  update and test py3.13 usage in CI and other scripts, and
  update other third-party dependencies, use latest skehttps://github.com/aboutcode-org/scancode-toolkit/pull/4430ull/4430

• Misc license detection improvements, new licenses and license
  detection ruleshttps://github.com/aboutcode-org/scancode-toolkit/pull/42614https://github.com/aboutcode-org/scancode-toolkit/pull/4412lhttps://github.com/aboutcode-org/scancode-toolkit/pull/4405uhttps://github.com/aboutcode-org/scancode-toolkit/pull/4278/https://github.com/aboutcode-org/scancode-toolkit/pull/4093it/pull/4093

• Fix an issues where pip install scancode-toolkit was failing
  because of a compatibility issue with Clichttps://github.com/aboutcode-org/scancode-toolkit/pull/44274427